Generalization Bound for Infinitely Divisible Empirical Process

نویسندگان

  • Chao Zhang
  • Dacheng Tao
چکیده

In this paper, we study the generalization bound for an empirical process of samples independently drawn from an infinitely divisible (ID) distribution, which is termed as the ID empirical process. In particular, based on a martingale method, we develop deviation inequalities for the sequence of random variables of an ID distribution. By applying the obtained deviation inequalities, we then show the generalization bound for ID empirical process based on the annealed VapnikChervonenkis (VC) entropy. Afterward, according to Sauer’s lemma, we get the generalization bound for ID empirical process based on the VC dimension. Finally, by using a resulted result bound, we analyze the asymptotic convergence of ID empirical process and show that the convergence rate of ID empirical process can reach O ((ΛF (2N) N ) 1 1.3 ) and it is faster than the results of the generic i.i.d. empirical process (Vapnik, 1999).

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Risk Bounds for Infinitely Divisible Distribution

In this paper, we study the risk bounds for samples independently drawn from an infinitely divisible (ID) distribution. In particular, based on a martingale method, we develop two deviation inequalities for a sequence of random variables of an ID distribution with zero Gaussian component. By applying the deviation inequalities, we obtain the risk bounds based on the covering number for the ID d...

متن کامل

A Generalization of the Results of Pillai

In a recent article Pillai (1990, Ann. Inst. Statist. Math., 42, 157-161) showed that the distribution 1-E~(-x~), 0 < c~ _< 1; 0 _< x, where E~(x) is the Mittag-Lettter function, is infinitely divisible and geometrically infinitely divisible. He also clarified the relation between this distribution and a stable distribution. In the present paper, we generalize his results by using Bernstein fun...

متن کامل

On causal stochastic equations for log-stable multiplicative cascades

We reformulate various versions of infinitely divisible cascades proposed in the literature using stochastic equations. This approach sheds a new light on the differences and common points of several formulations that have been recently provided by several teams. In particular, we focus on the simplification occurring when the infinitely divisible noise at the heart of such model is stable: an ...

متن کامل

Modeling of ‎I‎nfinite Divisible Distributions Using Invariant and Equivariant Functions

‎Basu’s theorem is one of the most elegant results of classical statistics‎. ‎Succinctly put‎, ‎the theorem says‎: ‎if T is a complete sufficient statistic for a family of probability measures‎, ‎and V is an ancillary statistic‎, ‎then T and V are independent‎. ‎A very novel application of Basu’s theorem appears recently in proving the infinite divisibility of certain statistics‎. ‎In addition ...

متن کامل

A New Tight Upper Bound on the Entropy of Sums

We consider the independent sum of a given random variable with a Gaussian variable and an infinitely divisible one. We find a novel tight upper bound on the entropy of the sum which still holds when the variable possibly has an infinite second moment. The proven bound has several implications on both information theoretic problems and infinitely divisible noise channels’ transmission rates.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011